Immersive object testing system

ABSTRACT

An object testing system and method for testing an object. A three-dimensional environment is displayed with a model of an object and an avatar from a viewpoint relative to the avatar on a display system viewed by a human operator. The object is under testing in a live environment. Information about motions of the human operator that are detected is generated. Live information about the object that is under testing in the live environment is received. A change in the object from applying the live information to the model of the object is identified. The change in the model of the object is displayed on the display system as seen from the viewpoint relative to the avatar in the three-dimensional environment.

CROSS-REFERENCE TO RELATED APPLICATION

This application is related to the following patent application:entitled “Immersive Design Management System”, U.S. patent applicationSer. No. 14/855,656; filed even date herewith, assigned to the sameassignee, and incorporated herein by reference.

BACKGROUND INFORMATION

1. Field

The present disclosure relates generally to managing an object and, inparticular, to managing the design of an object in an immersiveenvironment.

2. Background

Computer-aided design (CAD) software is often used in creating,modifying, or analyzing a design for an object. The object may be, forexample, an aircraft, a flight deck, a landing gear system, an enginehousing, or some other suitable object.

A designer may generate a computer-aided design of an object such as theflight deck of an aircraft using specifications, preliminary drawings,and other input. The computer-aided design is contained in a model ofthe object.

An analysis of the design may be performed. For example, an engineer mayperform a finite element analysis on the design of the flight deck. Thefinite element analysis may be used to determine how the object willhandle stress, temperatures, and other environmental factors.

Another person, an ergonomic specialist, may analyze the model withrespect to ergonomics. For example, the person may review the humanfactors in the design of the flight deck to determine whether a pilotmay interact efficiently with different components in the flight deck.

For example, the ergonomic specialist may review the dimensions forparts of the flight deck such as a seat, a flight stick, switches, andother parts that a pilot may interact with in the flight deck. Thereview of these dimensions may be used to determine whether sufficientergonomics are present in the design of the flight deck to performoperations for the aircraft. The dimensions may also be reviewed todetermine whether a desired level of comfort would be present for theflight of the aircraft. In some cases, the creation of some parts of theflight deck may be needed for the ergonomic analysis.

The engineer and the ergonomic specialist send feedback to the designer.The feedback may be a report sent by email or a hard copy that may besent by regular mail or overnight delivery.

The designer may then make changes to the model of the object using thefeedback. Further testing and analysis may be performed and furthermodifications to the model may be made in this manner until the flightdeck has a desired level of performance.

This type of process, however, involves multiple people interacting witheach other and may take more time than desired to perform iterations intesting, analysis, and modifying design changes. For example, schedulingbetween the designer, the engineer, and the ergonomic specialist toanalyze and modify the design may take more time than desired. Also, theengineer may need to schedule a time to run the finite element analysison the model of the flight deck.

The ergonomic specialist may not need the results of the finite elementanalysis, but may have other reviews for other designs in models ofother objects to perform prior to evaluating the design for the flightdeck. The analysis performed by the ergonomic specialist may requirefabrication of physical parts of the flight deck as needed. Also, eachtime a change in the model occurs, additional parts may be fabricated toevaluate the change in the model. The fabrication of the parts for theanalysis also may take more time and expense than desired.

Therefore, it would be desirable to have a method and apparatus thattake into account at least some of the issues discussed above, as wellas other possible issues. For example, it would be desirable to have amethod and apparatus that overcome a technical problem with managingdesign changes in models of objects.

SUMMARY

An illustrative embodiment of the present disclosure provides an objecttesting system comprising a motion capture system and a model manager.The motion capture system detects motions of a human operator andgenerates information about the motions. The model manager creates anavatar representing the human operator. The model manager also placesthe avatar in a three-dimensional environment with a model of an object.Further, the model manager displays the three-dimensional environmentwith the model of the object and the avatar from a viewpoint relative tothe avatar on a display system. Still further, the model managerreceives live information about the object that is under testing in alive environment. The model manager also identifies a change in theobject from applying the live information to the model of the object.Further, the model manager displays the change in the model of theobject on the display system as seen from the viewpoint relative to theavatar in the three-dimensional environment.

Another illustrative embodiment of the present disclosure provides amethod for testing an object. A three-dimensional environment isdisplayed with a model of the object and an avatar from a viewpointrelative to the avatar on a display system viewed by a human operator.The object is under testing in a live environment. Information aboutmotions of the human operator that are detected is generated. Liveinformation about the object that is under testing in the liveenvironment is received. A change in the object from applying the liveinformation to the model of the object is identified. The change in themodel of the object is displayed on the display system as seen from theviewpoint relative to the avatar in the three-dimensional environment.

The features and functions can be achieved independently in variousembodiments of the present disclosure or may be combined in yet otherembodiments in which further details can be seen with reference to thefollowing description and drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

The novel features believed characteristic of the illustrativeembodiments are set forth in the appended claims. The illustrativeembodiments, however, as well as a preferred mode of use, furtherobjectives and features thereof, will best be understood by reference tothe following detailed description of an illustrative embodiment of thepresent disclosure when read in conjunction with the accompanyingdrawings, wherein:

FIG. 1 is an illustration of a block diagram of an object immersionenvironment in accordance with an illustrative embodiment;

FIG. 2 is an illustration of an object immersion environment inaccordance with an illustrative embodiment;

FIG. 3 is an illustration of a display of a three-dimensionalenvironment to a human operator in accordance with an illustrativeembodiment;

FIG. 4 is an illustration of a display of a three-dimensionalenvironment to a human operator in accordance with an illustrativeembodiment;

FIG. 5 is an illustration of a display of a three-dimensionalenvironment to a human operator in accordance with an illustrativeembodiment;

FIG. 6 is an illustration of a display of a three-dimensionalenvironment to a human operator in accordance with an illustrativeembodiment;

FIG. 7 is an illustration of a display of a three-dimensionalenvironment to a human operator in accordance with an illustrativeembodiment;

FIG. 8 is an illustration of a live environment in accordance with anillustrative embodiment;

FIG. 9 is an illustration of a display of a three-dimensionalenvironment to a human operator using live information in accordancewith an illustrative embodiment;

FIG. 10 is an illustration of a display of a three-dimensionalenvironment to a human operator using live information in accordancewith an illustrative embodiment;

FIG. 11 is an illustration of a display of a three-dimensionalenvironment to a human operator in accordance with an illustrativeembodiment;

FIG. 12 is an illustration of a flowchart of a process for managing anobject in accordance with an illustrative embodiment;

FIG. 13 is an illustration of a flowchart of a process for testing anobject in accordance with an illustrative embodiment;

FIG. 14 is an illustration of a flowchart of a process for identifying achange in an object from applying live information in accordance with anillustrative embodiment;

FIG. 15 is an illustration of a flowchart of a process for placing anavatar into computer-aided design software in accordance with anillustrative embodiment;

FIG. 16 is an illustration of a flowchart of a process for applying liveinformation to a model in accordance with an illustrative embodiment;

FIG. 17 is an illustration of a block diagram of a data processingsystem in accordance with an illustrative embodiment;

FIG. 18 is an illustration of a block diagram of an aircraftmanufacturing and service method in accordance with an illustrativeembodiment;

FIG. 19 is an illustration of a block diagram of an aircraft inaccordance with an illustrative embodiment; and

FIG. 20 is an illustration of a block diagram of a product managementsystem in accordance with an illustrative embodiment.

DETAILED DESCRIPTION

The illustrative embodiments recognize and take into account one or moredifferent considerations. For example, the illustrative embodimentsrecognize and take into account that it would be desirable to reduce thenumber of people involved in designing and testing objects or reduce theeffort needed in performing iterations in testing, analysis, and designmodifications.

Thus, the illustrative embodiments provide a method and apparatus formanaging an object. In one illustrative example, a model manager createsan avatar representing the human operator and places the avatar in athree-dimensional environment with a model of the object. The modelmanager displays the three-dimensional environment with the model of theobject and the avatar from a viewpoint relative to the avatar on adisplay system. An interaction between the avatar and the model of theobject is identified by the model manager in real time using theinformation about the motions of the human operator detected in realtime from a motion capture system.

The interaction changes a group of dimensions in the model of theobject. As used herein, a “group of,” when used with reference to items,means one or more items. For example, a “group of dimensions” is one ormore dimensions. The model manager displays the interaction between theavatar and the model of the object in the three-dimensional environmenton the display system, enabling design changes in the model of theobject made by a human operator. As a result, the same person evaluatingthe design of an object may also make changes to the model of theobject.

With reference now to the figures and, in particular, with reference toFIG. 1, an illustration of a block diagram of an object immersionenvironment is depicted in accordance with an illustrative embodiment.In this illustrative example, object immersion environment 100 may beused to perform at least one of designing or analyzing object 102 usingmodel 104.

As used herein, the phrase “at least one of,” when used with a list ofitems, means different combinations of one or more of the listed itemsmay be used and only one of each item in the list may be needed. Inother words, “at least one of” means any combination of items and numberof items may be used from the list, but not all of the items in the listare required. The item may be a particular object, thing, or category.

For example, without limitation, “at least one of item A, item B, oritem C” may include item A, item A and item B, or item B. This examplealso may include item A, item B, and item C or item B and item C. Ofcourse, any combinations of these items may be present. In someillustrative examples, “at least one of” may be, for example, withoutlimitation, two of item A; one of item B; and ten of item C; four ofitem B and seven of item C; or other suitable combinations.

In the illustrative example, model 104 represents object 102. Model 104is an electronic representation of object 102.

As depicted, model 104 is a two-dimensional or three-dimensional designof object 102. For example, model 104 of object 102 may be selected fromone of a computer-aided design (CAD) model, a finite element method(FEM) model, a computer-aided (CAM) model, and some other type of model.

Object 102 may be a current object already in production or an objectthat may be produced at a future point in time. As depicted, object 102also may represent another object such as a prop, mockup, or prototype.Object 102 may take various forms. For example, object 102 may beselected from one of a mobile platform, a stationary platform, aland-based structure, an aquatic-based structure, a space-basedstructure, an aircraft, a surface ship, a tank, a personnel carrier, atrain, a spacecraft, a space station, a satellite, a submarine, anautomobile, a power plant, a bridge, a dam, a house, a manufacturingfacility, a building, a wing, a beam, an engine housing, a seat, astabilizer, and other suitable objects.

In this illustrative example, model manager 106 manages model 104 and isa component in object management system 108. Model manager 106 islocated in computer system 110 and is used in managing, designing, andtesting object 102. When object 102 is an aircraft, object managementsystem 108 may be an aircraft design system implementing model manager106.

Model manager 106 may be implemented in software, hardware, firmware, ora combination thereof. When software is used, the operations performedby model manager 106 may be implemented in program code configured torun on hardware, such as a processor unit. When firmware is used, theoperations performed by model manager 106 may be implemented in programcode and data and stored in persistent memory to run on a processorunit. When hardware is employed, the hardware may include circuits thatoperate to perform the operations in model manager 106.

In the illustrative examples, the hardware may take the form of acircuit system, an integrated circuit, an application-specificintegrated circuit (ASIC), a programmable logic device, or some othersuitable type of hardware configured to perform a number of operations.With a programmable logic device, the device may be configured toperform the number of operations. The device may be reconfigured at alater time or may be permanently configured to perform the number ofoperations. Programmable logic devices include, for example, aprogrammable logic array, programmable array logic, a field-programmablelogic array, a field-programmable gate array, and other suitablehardware devices. Additionally, the processes may be implemented inorganic components integrated with inorganic components and may becomprised entirely of organic components, excluding a human being. Forexample, the processes may be implemented as circuits in organicsemiconductors.

Computer system 110 is a hardware system and includes one or more dataprocessing systems. When more than one data processing system ispresent, those data processing systems may be in communication with eachother using a communications medium. The communications medium may be anetwork. The data processing systems may be selected from at least oneof a computer, a server computer, a tablet, or some other suitable dataprocessing system.

As depicted, model manager 106 immerses human operator 111 intothree-dimensional environment 112 in a manner that allows human operator111 to interact with three-dimensional environment 112 and, inparticular, with model 104 of object 102. The immersion of humanoperator 111 is such that human operator 111 is provided with a virtualreality experience such that three-dimensional environment 112 isvirtual reality environment 116.

During operation, model manager 106 creates avatar 118, representinghuman operator 111, and places avatar 118 into three-dimensionalenvironment 112 with model 104 of object 102. In the illustrativeexample, avatar 118 has dimensions 119 substantially matching humanoperator 111. In other words, avatar 118 may have dimensions 119 thatrepresent human operator 111 in three-dimensional environment 112.

In another illustrative example, avatar 118 may have dimensions 119 of aperson that performs ergonomic testing of object 102, rather thanmatching human operator 111. Ergonomic testing is testing the manner inwhich a human interacts with object 102. Ergonomic testing is used torefine object 102 to optimize for human use. Ergonomic testing mayinclude testing for at least one of usability, comfort, likelihood ofinjury, fatigue, discomfort, productivity, or other suitable factorsrelating to a human operator using object 102.

For example, testing of object 102 may be based on an average-sizedpilot. Avatar 118 may have dimensions 119 selected for a person such asan average-sized pilot, when human operator 111 is taller than theaverage-sized pilot.

In this manner, ergonomic testing may be performed in a desired manner.For example, when object 102 is an aircraft, interaction 120 of avatar118 with controls in the aircraft tests usability of the controls aspart of ergonomic testing. The usability may be, for example, how wellavatar 118 can reach and move the controls from a seat in the flightdeck.

Model manager 106 displays three-dimensional environment 112. Model 104of object 102 and avatar 118 are displayed by model manager 106 inthree-dimensional environment 112 from viewpoint 121 relative to avatar118 on display system 122 viewed by human operator 111.

In the illustrative example, viewpoint 121 relative to avatar 118 maybe, for example, a distance from avatar 118 or the eyes of avatar 118.When viewpoint 121 is a point that is a distance from avatar 118, thatdistance is fixed, and moves and turns as avatar 118 moves and turns.The distance may be changed based on a command from human operator 111or some other source. Further, viewpoint 121 may switch between thefixed distance and the eyes of avatar 118.

Model manager 106 identifies interaction 120 between avatar 118 andmodel 104 of object 102 in real time. Interaction 120 is detected usinginformation 126 about motions 128 of human operator 111 detected in realtime by motion capture system 130. Motion capture system 130 is acomponent in object management system 108.

In the illustrative example, display system 122 is selected from atleast one of a display device, a computer monitor, glasses, ahead-mounted display device, a tablet computer, a mobile phone, aprojector, a heads-up display, a holographic display system, a virtualretinal display, or some other suitable display device. As depicted,motion capture system 130 may take different forms. For example, motioncapture system 130 may include at least one of an optical motion capturesystem, an inertial motion capture system, a mechanical motion capturesystem, a magnetic motion capture system, a camera, an infrared camera,a laser scanner, an accelerometer system, a gyroscope, a motion capturesuit, or some other suitable device.

In the illustrative example, interaction 120 may take a number ofdifferent forms. As depicted, interaction 120 may be selected from oneof moving a portion of model 104 of object 102 that is designed to bemovable and displacing the portion of model 104 of object 102. In theillustrative example, a displacement, with respect to model 104, occurswhen a portion of model 104 of object 102 that is not designed to bemoveable is moved.

For example, a displacement occurs when interaction 120 increases ordecreases a bend in a wing. A displacement also occurs when interaction120 increases the length of a rod. As another example, a displacementoccurs when interaction 120 forms an indentation in the surface of anaircraft skin.

When interaction 120 moves or displaces a portion of model 104 of object102, interaction 120 changes a group of dimensions 132 in model 104 ofobject 102. The change in the group of dimensions 132 reflects thedisplacement caused by human operator 111 through avatar 118.

In this manner, human operator 111 may make design changes 134 to model104 of object 102. These and other types of interaction 120 that move aportion of model 104 of object 102 is not designed to move are adisplacement of model 104 that changes a group of dimensions 132.

As depicted, model manager 106 displays interaction 120 between avatar118 and model 104 of object 102 in three-dimensional environment 112 ondisplay system 122, enabling human operator 111 to make design changes134 in model 104 of object 102. In the illustrative example, modelmanager 106 updates file 136 storing model 104 of object 102 such thatfile 136 reflects change 138 in the group of dimensions 132 in model 104of object 102, enabling human operator 111 to make design changes 134 inmodel 104 of object 102. As depicted, file 136 may be, for example, acomputer-aided design (CAD) file, a finite element method (FEM) file, acomputer-aided (CAM) file, or some other suitable file.

In one illustrative example, object management system 108 may includecomputer-aided design system 144. In this example, some of theoperations performed by model manager 106 may be performed usingcomputer-aided design system 144 under the direction of model manager106. For example, computer-aided design system 144 displays model 104 inthree-dimensional environment 112. With this example, model manager 106directs movement of avatar 118 and identifies changes to group ofdimensions 119 based on interaction 120 of avatar 118 with model 104.

Model manager 106 may generate and send avatar 118 to computer-aideddesign system 144 for display. Computer-aided design system 144 displaysmodel 104 of object 102 in three-dimensional environment 112 with avatar118.

In this example, model manager 106 identifies movement of avatar 118occurring through identifying motions 128 of human operator 111 frommotion capture system 130. Model manager 106 controls movement of avatar118 and may direct computer-aided design system 144 on how avatar 118moves when object management system 108 includes computer-aided designsystem 144.

Thus, one or more technical solutions are present that overcome atechnical problem with managing design changes in models of objects. Asa result, one or more technical solutions using model manager 106 mayprovide a technical effect of reducing time needed to make designchanges to models of objects.

The illustrative embodiments also recognize and take into account thatpart of designing objects often includes testing of the objects. Forexample, objects are often tested in an environment that subjects theobjects to different conditions to determine how the objects perform.After the testing, the performance may be analyzed by an engineer todetermine how the object performed as compared to specificationsdefining a desired performance for the object.

In some cases, further testing may be needed. The illustrativeembodiments recognize and take into account that additional testing mayrequire working out logistics for performing the new tests. Further, insome cases, a new object may be needed for the test. The object testedmay have developed inconsistencies as a result of the test and, as aresult, may not be suitable for further testing.

Therefore, the illustrative embodiments recognize and take into accountthat it would be desirable to have a method and apparatus that take intoaccount at least some of the issues discussed above. For example, itwould be desirable to have a method and apparatus that overcome atechnical problem with the time and cost of testing objects.

Thus, in another illustrative example, object immersion environment 100may be applied to immerse human operator 111 in three-dimensionalenvironment 112 during testing of object 102. For example,three-dimensional environment 112 may be used to manage testing ofobject 102 in live environment 146 as an immersive object testingsystem.

For example, test 148 may be performed on object 102. In other words,test 148 is performed on object 102 as a physical object, rather thanusing a simulation of test 148 on object 102.

During operation, model manager 106 creates avatar 118 representinghuman operator 111 and places avatar 118 in three-dimensionalenvironment 112 with model 104 of object 102. Model manager 106 displaysthree-dimensional environment 112 with model 104 of object 102 andavatar 118 from viewpoint 121 relative to avatar 118 on display system122 viewed by human operator 111.

Further, model manager 106 receives live information 149 about object102 that is under testing in live environment 146. In the illustrativeexample, live information 149 includes at least one of modulation data,temperature, acceleration, velocity, translation, temperature, vibrationdata, force, acoustic data, or other suitable data.

Model manager 106 identifies change 138 in object 102 from applying liveinformation 149 to model 104 of object 102 and displays change 138 inmodel 104 of object 102 as seen from viewpoint 121 relative to avatar118. In the illustrative example, live information 149 may be applied tomodel 104 using analyzer 150. For example, analyzer 150 may be a finiteelement analysis system or some other suitable type of process.

In other words, model manager 106 receives live information 149 fromlive environment 146 for the object 102; identifies an effect of liveinformation 149 on model 104 of object 102 based on live information149, and displays effect on model 104 of object 102 in thethree-dimensional environment 112. Live environment 146 may be one inwhich object 102 is used during operation of object 102. In anotherexample, live environment 146 may be a test environment, such as alaboratory, a test chamber, a wind tunnel, or some other location.

In one example, model manager 106 displays a group of colors 152 onmodel 104 of object 102 in three-dimensional environment 112 as seenfrom viewpoint 121 relative to avatar 118 in which the group of colors152 indicates amounts of a group of parameters 154 for object 102. Forexample, the group of parameters 154 may be selected from at least oneof stress, strain, displacement, acoustics, computational fluid dynamics(CFD), temperature, or some other suitable parameter for object 102.

In the illustrative example, sensor system 155 generates liveinformation 149 about object 102 under testing in live environment 146.As depicted, sensor system 155 is selected from at least one of a laserscanner, a strain gauge, an accelerometer, a force sensing resistor, avibration sensor, a temperature sensor, an impact detector, a gyroscopicsensor, an inertial measurement unit, or some other suitable sensordevice.

As depicted, change 138 is displacement of object 102 and model 104 is afinite element method model. In identifying change 138 in object 102from applying live information 149 to model 104 of object 102, modelmanager 106 performs a finite element analysis on model 104 using liveinformation 149 about the displacement of object 102 and identifies thestress in object 102 from the finite element analysis.

In this illustrative example, human operator 111 and object 102 do notneed to be in the same location. For example, human operator 111 may bein first location 156, and object 102 that is under testing may be insecond location 158. For example, first location 156 may be a computerlab, while second location 158 may be an airspace over a desert.

With respect to testing of object 102, the illustrative embodimentsrecognize and take into account that during testing of object 102, thedata from the test are often reviewed after the test has completed. Forexample, measurements of displacement may be made during testing ofobject 102 with those measurements analyzed after testing is completed.

In some cases, the displacement may result in undesired inconsistenciesto occur in object 102. For example, if object 102 is a wing, cracks,delamination, breaks, or other inconsistencies may occur. As a result, anew object is manufactured for further testing. Manufacturing newobjects for testing may result in more time and expense for testingobjects than desired.

With displaying changes in in model 104 of object 102 during testing,test process 160 used in testing object 102 may be changed based onchange 138 identified in model 104 of object 102 as seen from viewpoint121 relative to avatar 118. The change in test process 160 may be madeduring a time selected from at least one of during a test of object 102or after the test of object 102.

In one illustrative example, one or more technical solutions are presentthat overcome a technical problem with a method and apparatus thatovercome a technical problem with managing design changes in models ofobjects. As a result, one or more technical solutions may provide atechnical effect of reducing time needed to make design changes inmodels of objects.

As a result, computer system 110 operates as a special purpose computersystem in which model manager 106 in computer system 110 enables humanoperator 111 to interact with and make design changes 134 in model 104through avatar 118. For example, changes were made in a group ofdimensions 132 in model 104 that may be saved in file 136 for later usein analysis, prototype fabrication, product manufacturing, or some othersuitable operation using model 104. In other words, the change is notmerely a graphical change that is displayed on display system 122. Thesechanges may be made in a manner to manage at least one of the design,testing, or production of object 102 in an illustrative example.

In particular, model manager 106 transforms computer system 110 into aspecial purpose computer system as compared to currently availablegeneral computer systems that do not have model manager 106. With modelmanager 106, changes to test process 160 may be made for test 148 ofobject 102. Change in test process 160 may occur during testing ofobject 102 through receiving live information 149 and immersing humanoperator 111 into three-dimensional environment one 112 to obtain avisualization of a group of parameters 154 of object 102 that iscurrently being tested. The visualization is performed in real time inthe illustrative example, and may be used to refine test process 160during or after test 148 with use of model manager 106.

The illustration of object immersion environment 100 in FIG. 1 is notmeant to imply physical or architectural limitations to the manner inwhich an illustrative embodiment may be implemented. Other components inaddition to or in place of the ones illustrated may be used. Somecomponents may be unnecessary. Also, the blocks are presented toillustrate some functional components. One or more of these blocks maybe combined, divided, or combined and divided into different blocks whenimplemented in an illustrative embodiment.

For example, a group of objects in addition to or in place of object 102may be placed into three-dimensional environment 112 using models forthe group of objects. Human operator 111 may interact with the group ofmodels for the group of objects in the same manner as with model 104 forobject 102.

In another illustrative example, three-dimensional environment 112 maybe viewed by another human operator in addition to human operator 111.The view may be from the same viewpoint or another displayed to humanoperator 111. In still another illustrative example, another avatar foranother human operator may be placed into three-dimensional environment112 in addition to avatar 118 for human operator 111. In this manner,multiple human operators may be immersed into three-dimensionalenvironment 112 and interact with object 102.

In yet another illustrative example, three-dimensional environment 112may take other forms other than virtual reality environment. Forexample, three-dimensional environment 112 may be an augmented realityenvironment.

With reference now to FIG. 2, an illustration of an object immersionenvironment is depicted in accordance with an illustrative embodiment.Object immersion environment 200 is an example of one implementation ofobject immersion environment 100 shown in block form in FIG. 1.

In this illustrative example, object immersion environment 200 includesmodel manager 202 and optical system 204. As depicted, model manager 202is implemented in a computer and is an example of one implementation formodel manager 106 shown in block form in FIG. 1. Optical system 204 isan example of one implementation for motion capture system 130 shown inblock form in FIG. 1.

As depicted, optical system 204 includes camera 208 and camera 210.These cameras individually or cooperatively capture data that may beused to obtain the three-dimensional position of human operator 212using a marker or markerless tracking system.

In this illustrative example, human operator 212 is an example of humanoperator 111 shown in block form in FIG. 1. In this illustrativeexample, human operator 212 wears head-mounted display 214 and markersuit 216.

Head-mounted display 214 is an example of a device that may be used toimplement display system 122 shown in block form in FIG. 1. As depicted,marker suit 216 may have reflective markers, light emitting diodes, orother types of passive or active markers that are detectable by opticalsystem 204 to identify motions of human operator 212.

Turning now to FIG. 3, an illustration of a display of athree-dimensional environment to a human operator is depicted inaccordance with an illustrative embodiment. In this illustrativeexample, display 300 is an example of a display seen by human operator212 on head-mounted display 214 in FIG. 2.

In this illustrative example, display 300 is a display of athree-dimensional environment generated by model manager 202 in FIG. 2.Display 300 shows avatar 302 with model 304 of a flight deck.

As depicted, display 300 is from a viewpoint relative to avatar 302. Theviewpoint in this example is from a point that is a distance away fromavatar 302, such as a third person viewpoint. Avatar 302 representshuman operator 212. For example, avatar 302 has dimensions thatcorrespond to human operator 212 in this particular example.

As depicted, human operator 212 may move with the motion beingtranslated into corresponding movement of avatar 302 with respect tomodel 304 of the flight deck. Thus, human operator 212 may be immersedin the virtual reality environment with movements of human operator 212being translated into corresponding movements of avatar 302.

In this illustrative example, the flight deck in model 304 includes seat306, seat 308, and controls 310. For example, controls 310 include,switches 312, flight stick 314, and flight stick 316. Other controls arepresent in model 304 of the flight deck, but are not described to avoidobscuring the description of the manner in which model manager 202operates to provide display 300.

Turning now to FIG. 4, an illustration of a display of athree-dimensional environment to a human operator is depicted inaccordance with an illustrative embodiment. In the illustrativeexamples, the same reference numeral may be used in more than onefigure. This reuse of a reference numeral in different figuresrepresents the same element in the different figures. In this view,motions of human operator 212 have caused avatar 302 to move into seat308 in model 304 of the flight deck.

With reference now to FIG. 5, an illustration of a display of athree-dimensional environment to a human operator is depicted inaccordance with an illustrative embodiment. In this figure, display 300is a viewpoint from the eyes of avatar 302 and is a first person pointof view. With this viewpoint, a more realistic view and immersion intothe three-dimensional environment with model 304 of the flight deck isprovided to human operator 212.

As depicted in this example, human operator 212 may have arm and handmovement such that right arm 500 with right hand 502 of avatar 302reaches and operates one or more of switches 312 as part of testingergonomics of the flight deck. As a result, human operator 212 isimmersed such that the operation of switches 312 appears to be thoseperformed by human operator 212.

With reference next to FIG. 6, an illustration of a display of athree-dimensional environment to a human operator is depicted inaccordance with an illustrative embodiment. Human operator 212 isfocused on flight stick 316 shown in display 300 from the viewpoint ofthe eyes of avatar 302.

In illustrative this example, avatar 302 grips flight stick 316 withleft hand 602 and right hand 502. Human operator 212 initiates a commandto change dimensions for flight stick 316. In this illustrative example,the command may be verbal commands such that human operator 212 does notneed to manipulate an input device and may focus on flight stick 316.

As depicted, human operator 212 moves left hand 602 in the direction ofarrow 604. Further, human operator also moves right hand 502 in thedirection of arrow 608. This movement, in essence, stretches flightstick 316. As a result, the dimensions of model 304 change and, inparticular, the dimensions for flight stick 316 in model 304.

With reference next to FIG. 7, an illustration of a display of athree-dimensional environment to a human operator is depicted inaccordance with an illustrative embodiment. In this illustration, flightstick 316 has changed in dimensions based on left hand 602 and righthand 502 pulling on flight stick 316.

These changes in dimensions in model 304 may be stored in the filecontaining model 304. As a result, the update to model 304 may be usedfor further testing, fabricating a prototype of the flight deck,manufacturing an actual flight deck in an aircraft, or other suitableoperations in designing the flight deck.

With reference next to FIG. 8, an illustration of a live environment isdepicted in accordance with an illustrative embodiment. In thisillustrative example, object immersion environment 200 includes modelmanager 202, optical system 204, and human operator 212 in firstlocation 800.

Additionally, aircraft 802 is shown in live environment 804 in secondlocation 805. In this example, aircraft 802 includes a deformationsensor system in the form of strain gauges 806 on wing 808 and wing 810.

Strain gauges 806 measure deformation in wing 808 and wing 810. Thesemeasurements form live information that is sent to model manager 202 asquickly as possible without intentional delay during testing of aircraft802. For example, live information is sent in real time from straingauges 806 to model manager 202. The live information may be sent overwireless connection 812 from aircraft 802 to model manager 202.

With reference now to FIG. 9, an illustration of a display of athree-dimensional environment to a human operator using live informationis depicted in accordance with an illustrative embodiment. Display 900is an example of a display seen by human operator 212 on head-mounteddisplay 214 in FIG. 8.

In this illustrative example, display 900 is a display of athree-dimensional environment generated by model manager 202 in FIG. 8using live information generated in live environment 804 in FIG. 8. Inthis illustrative example, avatar 302 is shown in display 900 with model902 of aircraft 802 in live environment 804.

As depicted, display 900 is from a viewpoint relative to avatar 302. Theviewpoint in this example is from a point that is a distance away fromavatar 302.

In this illustrative example, the live information is used to identifystress in wing 808 and wing 810 for aircraft in FIG. 8. As depicted, thestress is shown in display 900 using graphical indicators 904 on wing906 and wing 908 in model 902 of aircraft 802.

As depicted, graphical indicators 904 take the form of colors. Thecolors for graphical indicators 904 show where stress has beenidentified from the live information. The color is used to indicate theamount of stress in this illustrative example. For example, the colorblue indicates low stress, while the color red indicates high stress.The low stress may be stress that is within design tolerances, while thehigh stress may be a stress that is greater than a design tolerance forthe wing.

Turning next to FIG. 10, an illustration of a display of athree-dimensional environment to a human operator using live informationis depicted in accordance with an illustrative embodiment. In thisexample, human operator 212 has moved in a manner that caused avatar 302to move towards wing 906. Display 900 changes to an enlarged view of aportion of wing 906 based on movement of avatar 302 closer to wing 906in model 902 of aircraft 802.

With reference now to FIG. 11, an illustration of a display of athree-dimensional environment to a human operator is depicted inaccordance with an illustrative embodiment. In this figure, display 900is from a first person viewpoint from the eyes of avatar 302.

As depicted, human operator 212 may view the stress through graphicalindicators 904. Human operator 212 may view this information whenexamining the actual object under test if examining the object understress in person may be infeasible or does not have a desired level ofsafety.

Further, if other operators are viewing the three-dimensionalenvironment, human operator 212 may point to the location, such aslocation 1100, as the location of interest based on viewing graphicalindicators 904. In this example, human operator 212 points to location1100 through motions that translate into right hand 502 pointing tolocation 1100. In another illustrative example, human operator 212 maygraphically mark location 1100 for additional analysis. The marking maybe made through highlighting, coloring, a graphic, text, or some othersuitable marking mechanism.

The illustration of the object immersion environment and the liveenvironment in FIGS. 2-11 have been provided for purposes ofillustrating one illustrative example. The illustrations are not meantto limit the manner in which other illustrative examples may beimplemented. For example, other types of display systems may be usedinstead of a head-mounted display. Examples of other types of displaysystems include a display monitor, a holographic display system, or someother suitable type of display system that may be used depending on theimplementation and the desired level of immersion for a human operator.

As another example, the human operator may also use tactile feedbackdevices. For example, the human operator may wear cyber gloves thatprovide a force feedback to the human operator when interacting with anobject. This type of feedback may provide increased immersion into thethree-dimensional environment with the object.

In still other illustrative examples, the objects may be platforms otherthan an aircraft. For example, the objects may be a consumer electronicdevice, an office, or some other suitable type of object for whichobject immersion is desired. In yet another example, marker suit 216 maybe omitted when features on human operator 212 are used in place ofactual markers.

In still another illustrative example, other types of parameters otherthan stress may be shown for model 902 of aircraft 802. For example,temperature may be shown in addition to or in place of stress.

Turning next to FIG. 12, an illustration of a flowchart of a process formanaging an object is depicted in accordance with an illustrativeembodiment. The process illustrated in FIG. 12 may be implemented inobject immersion environment 100 in FIG. 1. In particular, the processmay be implemented using model manager 106 in object management system108.

The process begins by displaying a three-dimensional environment with amodel of an object and an avatar representing a human operator from aviewpoint relative to the avatar on a display system (operation 1200).The process detects a motion of the human operator (operation 1202). Theprocess identifies an interaction between the avatar and the model ofthe object in real time using the information about the motions of thehuman operator that are detected in real time (operation 1204).

A determination is made as to whether the interaction displaces aportion of the object that is not designed to be movable (operation1206). If the interaction moves a portion of an object not designed tobe movable, the interaction is a displacement.

If the interaction displaces a portion of the object, a group ofdimensions in the model of the object is changed (operation 1208). Theprocess displays the interaction between the avatar and the model objectin the three-dimensional environment on the display system (operation1210). With reference again to operation 1206, if the interaction movesa portion of the object that is designed to be movable, the processproceeds directly to operation 1210 from operation 1206. In this case, agroup of dimensions in the model of the object are not changed.

A determination is made as to whether use of the three-dimensionalenvironment is completed (operation 1212). If the use of thethree-dimensional environment is not completed, the process returns tooperation 1204.

Otherwise, the process determines whether a change has been made to agroup of dimensions in the model of the object (operation 1214). If achange has been made to the group of dimensions of the model of theobject, the process updates a file storing the model of the object suchthat the file reflects the change in the group of dimensions in themodel of the object (operation 1216) with the process terminatingthereafter. Otherwise, the process terminates without updating the file.

Turning now to FIG. 13, an illustration of a flowchart of a process fortesting an object is depicted in accordance with an illustrativeembodiment. The process illustrated in FIG. 13 may be implemented usingobject immersion environment 100 and live environment 146 in FIG. 1. Inparticular, one or more operations in this flowchart may be implementedusing model manager 106.

The process begins by testing an object in a live environment (operation1300). The process generates the live information about the object undertesting in the live environment with a sensor system (operation 1302).

The process displays a three-dimensional environment with a model of anobject and an avatar from a viewpoint relative to the avatar on adisplay system viewed by the human operator (operation 1304). Theprocess generates information about motions of a human operator that aredetected (operation 1306). The process receives live information aboutthe object that is under testing in the live environment (step 1308).

The process identifies a change in the object from applying the liveinformation to the model of the object (operation 1310). The processdisplays the change in the model of the object on the display system asseen from a viewpoint relative to the avatar in the three-dimensionalenvironment (operation 1312). In this example, operation 1312 maycomprise displaying a group of colors on the model of the object as seenfrom the point of view relative to the avatar in which the group ofcolors indicates amounts of stress for the object.

A determination is made as to whether testing of the object is complete(operation 1314). If the testing is completed, the process isterminated. Otherwise, the process returns to operation 1300.

With the process in FIG. 13, change in a test process used in testingthe object may be made based on the change identified in the object asseen from the viewpoint of the avatar. The change in the test process isperformed during a time selected from at least one of during a test ofthe object or after the test of the object. In this manner, moreefficient testing may occur.

The increased efficiency in testing may result in performing additionaltests during the testing session if a determination is made that theinitial test is completed as desired. In another illustrative example, aparticular test may be halted if the change displayed for the modelindicates that an undesired result may occur. For example, the undesiredresult may be an inconsistency being introduced into the object. Forexample, if the object is an aircraft, and a bank angle changing at aparticular rate indicates that a wing of the aircraft may begin to incurinconsistencies such as delamination or fractures, that maneuver may behalted. In a similar fashion, if forces are applied to a composite wingin a laboratory, the display of the change in the model of the compositewing may indicate that the amount of stress may cause delamination inthe composite wing. The test may then be halted prior to delaminationoccurring in the composite wing. In this manner, further testing may beperformed without fabricating another composite wing.

With reference next to FIG. 14, an illustration of a flowchart of aprocess for identifying a change in an object from applying liveinformation is depicted in accordance with an illustrative embodiment.The process in FIG. 14 is an example of one implementation for operation1310 in FIG. 13. In this example, the change is a displacement in theobject being tested.

The process begins by performing a finite element analysis on the modelusing the live information about the object (operation 1400). Theprocess identifies the stress in the object from the finite elementanalysis (step 1402) with the process terminating thereafter.

With reference next to FIG. 15, an illustration of a flowchart of aprocess for placing an avatar into computer-aided design software isdepicted in accordance with an illustrative embodiment. The processillustrated in FIG. 15 may be used to add avatar 118 in FIG. 1 intothree-dimensional environment 112 when three-dimensional environment 112is generated by computer-aided design system 144.

The process begins by generating information about the human operatorthrough a motion capture system (operation 1500). The information mayinclude at least one of the location of features or markers on the humanoperator in three dimensions.

The process creates a skeleton model of the human operator (operation1502). The skeleton model includes an identification of joint locationsand dimensions that are substantially the same as the human operator inthis example.

A determination is made as to whether the computer-aided design softwarecurrently includes an avatar (operation 1504). If the computer-aideddesign software currently includes an avatar, the skeleton model is sentto the computer-aided design software (operation 1506) with the processterminating thereafter.

If an avatar is not available in the computer-aided design software, theprocess adds a model of the avatar to the skeleton model (operation1508). The model includes a mesh for skin and attachments such asclothing and items that may be worn by the avatar or otherwise attachedto the avatar. In operation 1508, a mesh for the avatar is placed ontothe skeleton model to form the avatar. The process then sends thecompleted avatar to the computer-aided software (operation 1510) withthe process terminating thereafter. In this manner, an avatarrepresenting the human operator may be added for use with thecomputer-aided design software.

With reference now to FIG. 16, an illustration of a flowchart of aprocess for applying live information to a model is depicted inaccordance with an illustrative embodiment. The process illustrated inFIG. 16 may be implemented in model manager 106.

The process begins by receiving the live information (operation 1600).Thereafter, the process formats the live information for use in ananalyzer (operation 1602). In operation at 1602, the analyzer may be,for example, the finite element analysis process or some other suitabletype of analysis process. In the illustrative example, currently usedanalysis processes may be used with the live data formatted for use bythe process. Thereafter, the process forms a simulation using liveinformation (operation 1604). The process then displays the results ofthe analysis on the model (operation 1606) with the process returning tooperation 1600.

The flowcharts and block diagrams in the different depicted embodimentsillustrate the architecture, functionality, and operation of somepossible implementations of apparatuses and methods in an illustrativeembodiment. In this regard, each block in the flowcharts or blockdiagrams may represent at least one of a module, a segment, a function,or a portion of an operation or step. For example, one or more of theblocks may be implemented as program code, in hardware, or a combinationof the program code and hardware. When implemented in hardware, thehardware may, for example, take the form of integrated circuits that aremanufactured or configured to perform one or more operations in theflowcharts or block diagrams. When implemented as a combination ofprogram code and hardware, the implementation may take the form offirmware.

In some alternative implementations of an illustrative embodiment, thefunction or functions noted in the blocks may occur out of the ordernoted in the figures. For example, in some cases, two blocks shown insuccession may be performed substantially concurrently, or the blocksmay sometimes be performed in the reverse order, depending upon thefunctionality involved. Also, other blocks may be added in addition tothe illustrated blocks in a flowchart or block diagram.

For example, the process in FIG. 12 enables a human operator to makedesign changes to the model of the object. As a further enhancement, theprocess in FIG. 12 may include operations in which live information isdisplayed. For example, the process may receive live information from anenvironment of intended use for the object, identify a change in themodel from applying the live information to the model of the object, anddisplay the change in the model of the object in the three-dimensionalenvironment. In another illustrative example, in FIG. 13, operation 1300and operation 1302 may be performed at substantially the same time asoperation 1304 and 1306.

Turning now to FIG. 17, an illustration of a block diagram of a dataprocessing system is depicted in accordance with an illustrativeembodiment. Data processing system 1700 may be used to implementcomputer system 110 in FIG. 1. In this illustrative example, dataprocessing system 1700 includes communications framework 1702, whichprovides communications between processor unit 1704, memory 1706,persistent storage 1708, communications unit 1710, input/output (I/O)unit 1712, and display 1714. In this example, communication frameworkmay take the form of a bus system.

Processor unit 1704 serves to execute instructions for software that maybe loaded into memory 1706. Processor unit 1704 may be a number ofprocessors, a multi-processor core, or some other type of processor,depending on the particular implementation.

Memory 1706 and persistent storage 1708 are examples of storage devices1716. A storage device is any piece of hardware that is capable ofstoring information, such as, for example, without limitation, at leastone of data, program code in functional form, or other suitableinformation either on a temporary basis, a permanent basis, or both on atemporary basis and a permanent basis. Storage devices 1716 may also bereferred to as computer-readable storage devices in these illustrativeexamples. Memory 1706, in these examples, may be, for example, a randomaccess memory or any other suitable volatile or non-volatile storagedevice. Persistent storage 1708 may take various forms, depending on theparticular implementation.

For example, persistent storage 1708 may contain one or more componentsor devices. For example, persistent storage 1708 may be a hard drive, aflash memory, a rewritable optical disk, a rewritable magnetic tape, orsome combination of the above. The media used by persistent storage 1708also may be removable. For example, a removable hard drive may be usedfor persistent storage 1708.

Communications unit 1710, in these illustrative examples, provides forcommunications with other data processing systems or devices. In theseillustrative examples, communications unit 1710 is a network interfacecard.

Input/output unit 1712 allows for input and output of data with otherdevices that may be connected to data processing system 1700. Forexample, input/output unit 1712 may provide a connection for user inputthrough at least one of a keyboard, a mouse, or some other suitableinput device. Further, input/output unit 1712 may send output to aprinter. Display 1714 provides a mechanism to display information to auser.

Instructions for at least one of the operating system, applications, orprograms may be located in storage devices 1716, which are incommunication with processor unit 1704 through communications framework1702. The processes of the different embodiments may be performed byprocessor unit 1704 using computer-implemented instructions, which maybe located in a memory, such as memory 1706.

These instructions are referred to as program code, computer-usableprogram code, or computer-readable program code that may be read andexecuted by a processor in processor unit 1704. The program code in thedifferent embodiments may be embodied on different physical orcomputer-readable storage media, such as memory 1706 or persistentstorage 1708.

Program code 1718 is located in a functional form on computer-readablemedia 1720 that is selectively removable and may be loaded onto ortransferred to data processing system 1700 for execution by processorunit 1704. Program code 1718 and computer-readable media 1720 formcomputer program product 1722 in these illustrative examples. In oneexample, computer-readable media 1720 may be computer-readable storagemedia 1724 or computer-readable signal media 1726. In these illustrativeexamples, computer-readable storage media 1724 is a physical or tangiblestorage device used to store program code 1718, rather than a mediumthat propagates or transmits program code 1718.

Alternatively, program code 1718 may be transferred to data processingsystem 1700 using computer-readable signal media 1726. Computer-readablesignal media 1726 may be, for example, a propagated data signalcontaining program code 1718. For example, computer-readable signalmedia 1726 may be at least one of an electromagnetic signal, an opticalsignal, or any other suitable type of signal. These signals may betransmitted over at least one of communications links, such as wirelesscommunications links, an optical fiber cable, a coaxial cable, a wire,or any other suitable type of communications link.

The different components illustrated for data processing system 1700 arenot meant to provide architectural limitations to the manner in whichdifferent embodiments may be implemented. The different illustrativeembodiments may be implemented in a data processing system includingcomponents in addition to or in place of those illustrated for dataprocessing system 1700. Other components shown in FIG. 17 can be variedfrom the illustrative examples shown. The different embodiments may beimplemented using any hardware device or system capable of runningprogram code 1718.

Illustrative embodiments of the disclosure may be described in thecontext of aircraft manufacturing and service method 1800 as shown inFIG. 18 and aircraft 1900 as shown in FIG. 19. Turning first to FIG. 18,an illustration of a block diagram of an aircraft manufacturing andservice method is depicted in accordance with an illustrativeembodiment. During pre-production, aircraft manufacturing and servicemethod 1800 may include specification and design 1802 of aircraft 1900and material procurement 1804.

During production, component and subassembly manufacturing 1806 andsystem integration 1808 of aircraft 1900 takes place. Thereafter,aircraft 1900 may go through certification and delivery 1810 in order tobe placed in service 1812. While in service 1812 by a customer, aircraft1900 in is scheduled for routine maintenance and service 1814, which mayinclude modification, reconfiguration, refurbishment, and othermaintenance or service.

Each of the processes of aircraft manufacturing and service method 1800may be performed or carried out by a system integrator, a third party,an operator, or some combination thereof. In these examples, theoperator may be a customer. For the purposes of this description, asystem integrator may include, without limitation, any number ofaircraft manufacturers and major-system subcontractors; a third partymay include, without limitation, any number of vendors, subcontractors,and suppliers; and an operator may be an airline, a leasing company, amilitary entity, a service organization, and so on.

With reference now to FIG. 19, an illustration of a block diagram of anaircraft is depicted in which an illustrative embodiment may beimplemented. In this example, aircraft 1900 is produced by aircraftmanufacturing and service method 1800 in FIG. 18 and may includeairframe 1902 with a plurality of systems 1904 and interior 1906.Examples of systems 1904 include one or more of propulsion system 1908,electrical system 1910, hydraulic system 1912, and environmental system1914. Any number of other systems may be included. Although an aerospaceexample is shown, different illustrative embodiments may be applied toother industries, such as the automotive industry. Apparatuses andmethods embodied herein may be employed during at least one of thestages of aircraft manufacturing and service method 1800.

As yet another example, one or more apparatus embodiments, methodembodiments, or a combination thereof may be utilized during design andproduction stages. For example, model manager 106 in FIG. 1 may be usedto create and refine a design of aircraft 1900 in which the design isrepresented by a model, such as a computer-aided design model. The modelmay be updated using model manager 106 during component and subassemblymanufacturing 1806 and system integration 1808 based on informationreceived during these stages.

One or more apparatus embodiments, method embodiments, or a combinationthereof may be utilized while aircraft 1900 is in service 1812 in FIG.18, during maintenance and service 1814, or both. For example, modelmanager 106 may be used to change the design of parts needed duringmaintenance of aircraft 1900. The use of a number of the differentillustrative embodiments may substantially expedite the assembly ofaircraft 1900, reduce the cost of aircraft 1900, or both expedite theassembly of aircraft 1900 and reduce the cost of aircraft 1900.

Turning now to FIG. 20, an illustration of a block diagram of a productmanagement system is depicted in accordance with an illustrativeembodiment. Product management system 2000 is a physical hardwaresystem. In this illustrative example, product management system 2000 mayinclude at least one of manufacturing system 2002 or maintenance system2004. In the illustrative example, object management system 108 in FIG.1 may be used with product management system 2000 to produce objects,such as aircraft 1900 in FIG. 19.

Manufacturing system 2002 is configured to manufacture objects orproducts, such as aircraft 1900. As depicted, manufacturing system 2002includes manufacturing equipment 2006. Manufacturing equipment 2006includes at least one of fabrication equipment 2008 or assemblyequipment 2010.

Fabrication equipment 2008 is equipment that may be used to fabricatecomponents for parts used to form aircraft 1900. For example,fabrication equipment 2008 may include machines and tools. Thesemachines and tools may be at least one of a drill, a hydraulic press, afurnace, a mold, a composite tape laying machine, a vacuum system, alathe, or other suitable types of equipment. Fabrication equipment 2008may be used to fabricate at least one of metal parts, composite parts,semiconductors, circuits, fasteners, ribs, skin panels, spars, antennas,or other suitable types of parts.

Assembly equipment 2010 is equipment used to assemble parts to formaircraft 1900. In particular, assembly equipment 2010 may be used toassemble components and parts to form aircraft 1900. Assembly equipment2010 also may include machines and tools. These machines and tools maybe at least one of a robotic arm, a crawler, a faster installationsystem, a rail-based drilling system, a robot, or other suitable typesof equipment. Assembly equipment 2010 may be used to assemble parts suchas seats, horizontal stabilizers, wings, engines, engine housings,landing gear systems, and other parts for aircraft 1900.

In this illustrative example, maintenance system 2004 includesmaintenance equipment 2012. Maintenance equipment 2012 may include anyequipment needed to perform maintenance on aircraft 1900. Maintenanceequipment 2012 may include tools for performing different operations onparts on aircraft 1900. These operations may include at least one ofdisassembling parts, refurbishing parts, inspecting parts, reworkingparts, manufacturing placement parts, or other operations for performingmaintenance on aircraft 1900. These operations may be for routinemaintenance, inspections, upgrades, refurbishment, or other types ofmaintenance operations.

In the illustrative example, maintenance equipment 2012 may includeultrasonic inspection devices, x-ray imaging systems, vision systems,drills, crawlers, or other suitable devices. In some cases, maintenanceequipment 2012 may include fabrication equipment 2008, assemblyequipment 2010, or both to produce and assemble parts that may be neededfor maintenance.

Product management system 2000 also includes control system 2014.Control system 2014 is a hardware system, and may also include softwareor other types of components. Control system 2014 is configured tocontrol the operation of at least one of manufacturing system 2002 ormaintenance system 2004. For example, control system 2014 may controloperation of manufacturing system 2002 using model 104 in FIG. 1. Inparticular, control system 2014 may control the operation of at leastone of fabrication equipment 2008, assembly equipment 2010, ormaintenance equipment 2012 using model 104.

In the illustrative example, object management system 108, includingmodel manager 106, may communicate with control system 2014 as part of aprocess to manufacture objects, such as aircraft 1900 or parts ofaircraft 1900. Model manager 106 in FIG. 1 may allow for changes in thedesign of aircraft 1900 to be made more quickly and more efficientlywith less cost, and send model 104 to control system 2014 for use inmanufacturing or performing maintenance for aircraft 1900. A design foraircraft 1900 may be supplied to control system 2014 to manufactureaircraft 1900 or parts for aircraft 1900 by manufacturing system 2002.Also, adjustments to aircraft 1900 may be identified in model 104 foruse in maintenance system 2004 using model manager 106.

The hardware in control system 2014 may use hardware that may includecomputers, circuits, networks, and other types of equipment. The controlmay take the form of direct control of manufacturing equipment 2006. Forexample, robots, computer-controlled machines, and other equipment maybe controlled by control system 2014. In other illustrative examples,control system 2014 may manage operations performed by human operators2016 in manufacturing or performing maintenance on aircraft 1900. Forexample, control system 2014 may assign tasks, provide instructions,display models, or perform other operations to manage operationsperformed by human operators 2016. In these illustrative examples, modelmanager 106 in FIG. 1 may be in communication with or may be implementedin control system 2014 to manage at least one of the manufacturing ormaintenance of aircraft 1900.

In the different illustrative examples, human operators 2016 may operateor interact with at least one of manufacturing equipment 2006,maintenance equipment 2012, or control system 2014. This interaction maybe performed to manufacture aircraft 1900.

Of course, product management system 2000 may be configured to manageother products other than aircraft 1900. Although aircraft managementsystem 2000 has been described with respect to manufacturing in theaerospace industry, aircraft management system 2000 may be configured tomanage products for other industries. For example, aircraft managementsystem 2000 may be configured to manufacture products for the automotiveindustry as well as any other suitable industries.

Thus, one or more of the illustrative examples provide one or moretechnical solutions that overcome a technical problem with managingdesign changes in models of objects. As a result, one or more technicalsolutions using model manager 106 may provide a technical effect ofreducing time needed to make design changes in models of objects. Asdepicted, model manager 106 may be used to provide immersion into avirtual reality environment that allows for ergonomic testing. Further,changes to a design of an object during this testing or for otherreasons may be made by the human operator making motions translated intothose of the avatar to change dimensions in the model of the object.

In yet another illustrative example, live information may be obtainedfrom testing of the object in a live environment. This data may bereceived in real time such that changes in the testing procedures mayoccur while the testing is in progress. In this manner, the time andexpense needed to test objects may be reduced and additional tests maybe avoided by changing the current test. For example, parameters to betested in a second test may be during the first test if the first testis successful in time, and resources designated for the first test arestill present for testing the object.

The description of the different illustrative embodiments has beenpresented for purposes of illustration and description, and is notintended to be exhaustive or limited to the embodiments in the formdisclosed. The different illustrative examples describe components thatperform actions or operations. In an illustrative embodiment, acomponent may be configured to perform the action or operationdescribed. For example, the component may have a configuration or designfor a structure that provides the component an ability to perform theaction or operation that is described in the illustrative examples asbeing performed by the component.

Many modifications and variations will be apparent to those of ordinaryskill in the art. Further, different illustrative embodiments mayprovide different features as compared to other desirable embodiments.The embodiment or embodiments selected are chosen and described in orderto best explain the principles of the embodiments, the practicalapplication, and to enable others of ordinary skill in the art tounderstand the disclosure for various embodiments with variousmodifications as are suited to the particular use contemplated.

What is claimed is:
 1. An object testing system comprising: a motioncapture system having: at least one storage device for storing programcode; and at least one processor for processing the program code todetect motions of a human operator and generate information about themotions; and a model manager having: at least one storage device forstoring program code; and at least one processor for processing theprogram code to: create an avatar representing the human operator; placethe avatar in a three-dimensional environment with a model of an object;display the three-dimensional environment with the model of the objectand the avatar from a viewpoint relative to the avatar on a displaysystem, wherein the information about the motions is used to controlmovements of the avatar; receive, using a first test process to test theobject in a live environment, a first set of live data about the objectthat is under testing in the live environment; determine, based on thefirst set of live data, whether there is a change in the object, whereindetermining whether there is a change in the object includes performinga finite element analysis on the model of the object using the first setof live data about the object to identify stresses in the object; applythe change to the model of the object in response to determining thatthere is a change to the object; display the change in the model of theobject on the display system in response to determining that the changecan be seen in the model of the object from the viewpoint relative tothe avatar in the three-dimensional environment; and change the firsttest process used in testing the object based on the change identifiedin the model of the object as seen from the viewpoint relative to theavatar to a second test process to receive a second set of live data. 2.The object testing system of claim 1 further comprising: a sensor systemincluding: at least one storage device for storing program code; and atleast one processor for processing the program code to generate thefirst set and the second set of live data about the object under testingin the live environment.
 3. The object testing system of claim 2,wherein the sensor system is selected from at least one of a laserscanner, a strain gauge, an accelerometer, a force sensing resistor, avibration sensor, a temperature sensor, an impact detector, a gyroscopicsensor, or an inertial measurement unit.
 4. The object testing system ofclaim 1, wherein in displaying the change in the model of the object asseen from the viewpoint relative to the avatar, the model managerdisplays a group of colors on the model of the object as seen from theviewpoint relative to the avatar in which the group of colors indicatesamounts of a group of parameters of the object, wherein the group ofparameters is selected from at least one of stress, strain,displacement, acoustics, computational fluid dynamics, or temperature ofthe object.
 5. The object testing system of claim 1, wherein the firstset and the second set of live data about the object include at leastone of modulation data, temperature, acceleration, velocity,translation, vibration data, force, or acoustic data.
 6. The objecttesting system of claim 1, wherein the human operator is in a firstlocation and the object that is under testing is in a second location.7. The object testing system of claim 1, wherein the model is selectedfrom one of a computer-aided design model, a finite element methodmodel, or a computer-aided model.
 8. The object testing system of claim1, wherein the display system is selected from at least one of a displaydevice, a computer monitor, glasses, a head-mounted display device, atablet computer, a mobile phone, a projector, a heads up display, aholographic display system, or a virtual retinal display.
 9. The objecttesting system of claim 1, wherein the object is selected from one of amobile platform, a stationary platform, a land-based structure, anaquatic-based structure, a space-based structure, an aircraft, a surfaceship, a tank, a personnel carrier, a train, a spacecraft, a spacestation, a satellite, a submarine, an automobile, a power plant, abridge, a dam, a house, a manufacturing facility, a building, a wing, abeam, an engine housing, a seat, and a stabilizer.
 10. A method fortesting an object, the method comprising: displaying a three-dimensionalenvironment with a model of the object and an avatar from a viewpointrelative to the avatar on a display system viewed by a human operator,wherein the object is being tested using a first test process in a liveenvironment; generating information about motions of the human operatorthat are detected, the information being used to control movements ofthe avatar; receiving a first set of live data about the object that isunder testing in the live environment; determining, based on the firstset of live data, whether there is a change in the model of the object,wherein determining whether there is a change in the model of the objectincludes performing a finite element analysis on the model using thefirst set of live data about the object to identify stresses in theobject; displaying the change in the model of the object on the displaysystem in response to determining that there is a change in the model ofthe object and the change can be seen from the viewpoint relative to theavatar in the three-dimensional environment; and changing the first testprocess used in testing the object to a second test process based on thechange identified in the model of the object as seen from the viewpointrelative to the avatar to receive a second set of live data.
 11. Themethod of claim 10, wherein the first set and the second set of livedata about the object under testing in the live environment aregenerated using a sensor system.
 12. The method of claim 11, wherein thesensor system is selected from at least one of a laser scanner, a straingauge, an accelerometer, a force sensing resistor, a vibration sensor, atemperature sensor, an impact detector, a gyroscopic sensor, or aninertial measurement unit.
 13. The method of claim 10, whereindisplaying the change in the model of the object as seen from theviewpoint relative to the avatar comprises: displaying a group of colorson the model of the object as seen from the viewpoint relative to theavatar in which the group of colors indicates amounts of a parameter ofthe object, wherein the parameter is selected from one of stress,strain, displacement, acoustics, computational fluid dynamics, andtemperature of the object.
 14. The method of claim 10, wherein the firsttest process is changed to the second test process during a timeselected from at least one of during a test of the object or after thetest of the object.
 15. The method of claim 10, wherein the first setand the second set of live data about the object include at least one ofmodulation data, temperature, acceleration, velocity, translation,vibration data, force, or acoustic data.
 16. The method of claim 10,wherein the human operator is in a first location and the object that isunder testing is in a second location.
 17. The method of claim 10,wherein the model is selected from one of a computer-aided design model,a finite element method model, and a computer-aided model.
 18. Themethod of claim 10, wherein the display system is selected from at leastone of a display device, a computer monitor, glasses, a head-mounteddisplay device, a tablet computer, a mobile phone, a projector, a headsup display, a holographic display system, or a virtual retinal display.19. The method of claim 10, wherein the object is selected from one of amobile platform, a stationary platform, a land-based structure, anaquatic-based structure, a space-based structure, an aircraft, a surfaceship, a tank, a personnel carrier, a train, a spacecraft, a spacestation, a satellite, a submarine, an automobile, a power plant, abridge, a dam, a house, a manufacturing facility, a building, a wing, abeam, an engine housing, a seat, and a stabilizer.
 20. A method oftesting an object comprising: testing the object using a first testprocess to receive a first set of test data; displaying a model of theobject being tested in a three-dimensional environment along with anavatar, the avatar representing an operator of the avatar, whereinmotions from the operator control movements of the avatar; determining,based on the first set of test data, whether or not changes occur to theobject in response to the object being tested, wherein to determinewhether or not changes occur to the object, a finite element analysis onthe model using live information about the object being tested isperformed, the finite element analysis being performed to identifystresses in the object; determining, in response to determining thatchanges occur to the object and using the avatar, whether or not atleast one of the changes should be displayed in the model of the object;displaying the at least one of the changes to the object in the model ofthe object in response to determining that the at least one of thechanges should be displayed in the model of the object; and changing thefirst test process used in testing the object to a second test processto receive a second set of test data based on the at least one of thechanges.
 21. The method of claim 20, wherein an avatar representing athree-dimensional model of a human tester is displayed in a particularorientation in the three-dimensional environment.
 22. The method ofclaim 21, wherein the at least one of the changes to the object isdisplayed in response to determining that the at least one of thechanges may be seen from a viewpoint relative to the avatar.
 23. Themethod of claim 22, wherein the human tester tests the object by havingthe avatar act on the model of the object.
 24. The method of claim 22,wherein the at least one of the changes is a change in color.
 25. Themethod of claim 24, wherein the change in color corresponds to one ofstress, strain, displacement, acoustics, computational fluid dynamics,and temperature of the object.
 26. The method of claim 22, wherein themodel of the object includes at least one surface and the at least oneof the changes is a displacement in the at least one surface.
 27. Themethod of claim 26, wherein the displacement is an undesiredinconsistency.